Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence

Incremental learning (IL) has received a lot of attention recently, however, the literature lacks a precise problem definition, proper evaluation settings, and metrics tailored specifically for the IL problem. One of the main objectives of this work is to fill these gaps so as to provide a common ground for better understanding of IL. The main challenge for an IL algorithm is to update the classifier whilst preserving existing knowledge. We observe that, in addition to forgetting, a known issue while preserving knowledge, IL also suffers from a problem we call intransigence, inability of a model to update its knowledge. We introduce two metrics to quantify forgetting and intransigence that allow us to understand, analyse, and gain better insights into the behaviour of IL algorithms. We present RWalk, a generalization of EWC++ (our efficient version of EWC [Kirkpatrick2016EWC]) and Path Integral [Zenke2017Continual] with a theoretically grounded KL-divergence based perspective. We provide a thorough analysis of various IL algorithms on MNIST and CIFAR-100 datasets. In these experiments, RWalk obtains superior results in terms of accuracy, and also provides a better trade-off between forgetting and intransigence

Efficient feedback controllers for continuous-time quantum error correction

We present an efficient approach to continuous-time quantum error correction that extends the low-dimensional quantum filtering methodology developed by van Handel and Mabuchi [quant-ph/0511221 (2005)] to include error recovery operations in the form of real-time quantum feedback. We expect this paradigm to be useful for systems in which error recovery operations cannot be applied instantaneously. While we could not find an exact low-dimensional filter that combined both continuous syndrome measurement and a feedback Hamiltonian appropriate for error recovery, we developed an approximate reduced-dimensional model to do so. Simulations of the five-qubit code subjected to the symmetric depolarizing channel suggests that error correction based on our approximate filter performs essentially identically to correction based on an exact quantum dynamical model

Generalized Limits for Single-Parameter Quantum Estimation

We develop generalized bounds for quantum single-parameter estimation problems for which the coupling to the parameter is described by intrinsic multi-system interactions. For a Hamiltonian with $k$-system parameter-sensitive terms, the quantum limit scales as $1/N^k$ where $N$ is the number of systems. These quantum limits remain valid when the Hamiltonian is augmented by any parameter independent interaction among the systems and when adaptive measurements via parameter-independent coupling to ancillas are allowed.Comment: 4 pages, 1 figure. v2 typos correcte

Diet tracing in ecology: Method comparison and selection

1. Determining diet is a key prerequisite for understanding species interactions, food web structure and ecological dynamics. In recent years, there has been considerable development in both the methodology and application of novel and more traditional dietary tracing methods, yet there is no comprehensive synthesis that systematically and quantitatively compares among the different approaches. 2. Here we conceptualize diet tracing in ecology, provide recommendations for method selection, and illustrate the advantages of method integration. We summarize empirical evidence on how different methods quantify diet mixtures, by contrasting estimates of dietary proportions from multiple methods applied to the same consumer-resource datasets, or from experimental studies with known diet compositions. 3. Our data synthesis revealed an urgent need for more experiential comparisons among the dietary methods. The comparison of diet quantifications from field observations showed that different techniques aligned well in cases with less than six diet items, but diverged considerably when applied to more complex diet mixtures. 4. Efforts are ongoing to further advance dietary estimation, including how reliably compound specific stable isotope analyses and fatty acid profiles can quantify more prey items than bulk stable isotope analyses. Similarly, DNA analyses, which can depict trophic interactions at a higher resolution than any other methods, are generating new ways to better quantify diets and differentiate among life-stages of prey. Such efforts, combined with more empirical testing of each dietary method and establishment of open data repositories for dietary data, promise to greatly advance community and ecosystem ecology

Diversity and temperature indirectly reduce CO2 concentrations in experimental freshwater communities.

Biodiversity loss and climate warming are occurring in concert, with potentially profound impacts on ecosystem functioning. We currently know very little about the combined effects of these changes on the links between the community structure, dynamics and the resulting in situ CO2 concentrations in freshwater ecosystems. Here we aimed to determine both individual and combined effects of temperature and non-resource diversity (species inedible for a given consumer) on CO2 concentration. Our analysis further aimed to establish both direct effects on CO2 concentrations and potential indirect effects that occur via changes to the phytoplankton and zooplankton biomasses. Our results showed that there were no interactive effects of changes in temperature and diversity on CO2 concentration in the water. Instead, independent increases in either temperature or non-resource diversity resulted in a substantial reduction in CO2 concentrations, particularly at the highest non-resource diversity. The effects of non-resource diversity and warming on CO2 were indirect, resulting largely from the positive impacts on total biomass of primary producers. Our study is the first to experimentally partition the impacts of temperature and diversity on the consumer-resource dynamics and associated changes to CO2 concentrations. It provides new mechanistic insights into the role of diverse plankton communities for ecosystem functioning and their importance in regulating CO2 dynamics under ongoing climate warming

Behavioral Inhibition as a Risk Factor for the Development of Childhood Anxiety Disorders: A Longitudinal Study

This longitudinal study examined the additive and interactive effects of behavioral inhibition and a wide range of other vulnerability factors in the development of anxiety problems in youths. A sample of 261 children, aged 5 to 8 years, 124 behaviorally inhibited and 137 control children, were followed during a 3-year period. Assessments took place on three occasions to measure children’s level of behavioral inhibition, anxiety disorder symptoms, other psychopathological symptoms, and a number of other vulnerability factors such as insecure attachment, negative parenting styles, adverse life events, and parental anxiety. Results obtained with Structural Equation Modeling indicated that behavioral inhibition primarily acted as a specific risk factor for the development of social anxiety symptoms. Furthermore, the longitudinal model showed additive as well as interactive effects for various vulnerability factors on the development of anxiety symptoms. That is, main effects of anxious rearing and parental trait anxiety were found, whereas behavioral inhibition and attachment had an interactive effect on anxiety symptomatology. Moreover, behavioral inhibition itself was also influenced by some of the vulnerability factors. These results provide support for dynamic, multifactorial models for the etiology of child anxiety problems

Far-Ultraviolet Radiation from Elliptical Galaxies

Far-ultraviolet radiation is a ubiquitous, if unanticipated, phenomenon in elliptical galaxies and early-type spiral bulges. It is the most variable photometric feature associated with old stellar populations. Recent observational and theoretical evidence shows that it is produced mainly by low-mass, small-envelope, helium-burning stars in extreme horizontal branch and subsequent phases of evolution. These are probably descendents of the dominant, metal rich population of the galaxies. Their lifetime UV outputs are remarkably sensitive to their physical properties and hence to the age and the helium and metal abundances of their parents. UV spectra are therefore exceptionally promising diagnostics of old stellar populations, although their calibration requires a much improved understanding of giant branch mass loss, helium enrichment, and atmospheric diffusion.Comment: 46 pages; includes LaTeX text file, 9 PS figures, 1 JPG figure, 2 style files. Full resolution figures and PS version available at http://www.astro.virginia.edu/~rwo/araa99/. Article to appear in Annual Reviews of Astronomy & Astrophysics, 199

Decoherence Rates in Large Scale Quantum Computers and Macroscopic Systems

Markovian regime decoherence effects in quantum computers are studied in terms of the fidelity for the situation where the number of qubits N becomes large. A general expression giving the decoherence time scale in terms of Markovian relaxation elements and expectation values of products of system fluctuation operators is obtained, which could also be applied to study decoherence in other macroscopic systems such as Bose condensates and superconductors. A standard circuit model quantum computer involving three-state lambda system ionic qubits is considered, with qubits localised around well-separated positions via trapping potentials. The centre of mass vibrations of the qubits act as a reservoir. Coherent one and two qubit gating processes are controlled by time dependent localised classical electromagnetic fields that address specific qubits, the two qubit gating processes being facilitated by a cavity mode ancilla, which permits state interchange between qubits. With a suitable choice of parameters, it is found that the decoherence time can be made essentially independent of N.Comment: Minor revisions. To be published in J Mod Opt. One figur

Discourse or dialogue? Habermas, the Bakhtin Circle, and the question of concrete utterances

This is the author's accepted manuscript. The final publication is available at Springer via the link below.This article argues that the Bakhtin Circle presents a more realistic theory of concrete dialogue than the theory of discourse elaborated by Habermas. The Bakhtin Circle places speech within the “concrete whole utterance” and by this phrase they mean that the study of everyday language should be analyzed through the mediations of historical social systems such as capitalism. These mediations are also characterized by a determinate set of contradictions—the capital-labor contradiction in capitalism, for example—that are reproduced in unique ways in more concrete forms of life (the state, education, religion, culture, and so on). Utterances always dialectically refract these processes and as such are internal concrete moments, or concrete social forms, of them. Moreover, new and unrepeatable dialogic events arise in these concrete social forms in order to overcome and understand the constant dialectical flux of social life. But this theory of dialogue is different from that expounded by Habermas, who tends to explore speech acts by reproducing a dualism between repeatable and universal “abstract” discursive processes (commonly known as the ideal speech situation) and empirical uses of discourse. These critical points against Habermas are developed by focusing on six main areas: sentences and utterances; the lifeworld and background language; active versus passive understandings of language; validity claims; obligation and relevance in language; and dialectical universalism